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Amendments to the Claims: ^ ^ ^ 2006 

This listing of claims will replace all prior versions, and listings, of claims in the 

application: 
Listing of Claims: 

1. (Currently Amended) A HierarchicalSummary Description Scheme (DS) for 
describing a video summary, the HierarchicalSummary DS comprising: a HighlightLevel DS that 
oompriscs-jncludes at ,east one HighlightSegment DS, the HighlightSegment DS configured to 
describe information on a highlight segment corresponding to one of a plurality of video summary 
intervals, the HighlightSegment DS further comprising -including a VideoSegmentLocator DS | 
describing time mfbrmation or a video itself of the highlight segment and an ImageLocator DS 
describing a representative frame of the highlight segment. 

2. (Previously Presented) The HierarchicalSummary DS of claim 1 wherein 
said HighlightLevel DS further comprises at least one lower level HighlightLevel DS. 

S3- 

3. -4. (Canceled) *^ 

5. (Currently Amended) The HierarchicalSummaxy DS of claim ^Lwherein 
said HighlightSegment DS further comprises a SoundLocator DS that describes the representative 
sound information of said corresponding highlight segment p 

-> 

6. -7. (Canceled). } 

i 

8. (Currently Amended) The HierarchicalSummary DS of claim 3-l_wherein 
said HighlightSegment DS further comprises an AudioSegmentLocator DS that describes the audio 
segment information constituting an audio summary of said corresponding highlight segment 

9. (Canceled) 



□ 
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10. (Previously Presented) The HierarchicalSummary DS of claim 8 wherein 
the HierarchicalSummary DS includes an attribute of a SummaryComponentList that describes and 
enumerates SummaiyCompon entTypes representing types of summary. 

11. (Previously Presented) The HierarchicalSummary DS of claim 10 wherein 
said SummaryComponentType comprises keyFrames representing a key frame summary composed 
of representative frames, keyVideoClips representing a key video clip summary composed of key 
video segment' sets, keyEvents representing a summary of a video interval corresponding to either 
an event or a subject, and keyAudioCIips representing a key audio clip summary composed of 
representative audio intervals' sets, and an unconstraint representing the type of summary defined 
by users except for said summaries. 



12. (Previously Presented) The HierarchicalSummary DS of claim 1 wherein 
the HierarchicalSummary DS further includes a SummaryThemeList DS enumerating the event or 
subject comprised in the summary and enabling users to execute summarizing and browsing based 
on the event 



13. (Previously Presented) The HierarchicalSummaiy DS of claim 12 wherein 
the SummaryThemeList DS comprises an arbitrary number of SummaryThemes as elements, and 
the Summary Theme includes an attribute of and ID representing a corresponding event or subject. 

14. (Previously Presented) The HierarchicalSummary DS of claim 13 wherein 
the SummaryTheme further includes an attribute of parentID that describes the ID of the event or 
subject of the upper level. 



15. (Previously Presented) The HierarchicalSummaiy DS of claim 13 wherein 
the HighlightLevel DS comprises an attribute of themelDs describing an attribute of the ID, when 
the HighlightSegments or HighlightLevels that constitute a corresponding highlight level have 
common events or subjects, the ID of the common events or the subjects is described in the 
themcID. 

3 
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16. (Previously Presented) The HierarchicalSummary DS of claim 13 wherein 
the HighlightSegment DS comprises an attribute of themelDs describing the event or subject of the 
highlight segment using the attribute of ID described in the SummaryTbemeList DS. 

17. (Previously Presented) A computer-readable recording medium where a 
HierarchicalSummary DS for describing a video summary is stored therein, wherein the 
HierarchicalSummary DS comprises a HighlightLevel DS that comprises at least one 
HighlightSegment DS, the HighlightSegment DS describes information on a highlight segment 
corresponding to one of a plurality of video summary intervals, and the HighlightSegment DS 
further comprises a VideoSegmentLocator DS describing time information or a video itself of the 
highlight segment and an ImageLocator DS describing a representative frame of the highlight 
segment. 



18. (Currently Amended) A method for generating video summary description 
data according to a video summary description scheme by inputting original video, comprising: 

(a) analyzing the input original video and producing video analysis result; 

(b) defining a summary rule for selecting the video summary interval; 

(c) selecting the video summary interval capable of summarizing video contents 
from the original video based on the original video analysis result and the summary rule and 
constituting video summary interval information; 

(d) extracting a representative frame based on the video summary interval 
information; and 

(e) generating video summary description data according to the 
HierarcmcalSummary DS enabling to execute execution of hi erarchic! browsing based on the | 
video summary interval information and the representative frame, 

wherein the HeirarchicalSummary DS comprises a HighlightLevel DS that 
comprises at least one HighlightSegment DS, and the HighlightSegment DS describes information 
on a highlight segment corresponding to one of a plurality of video summary intervals, and the 
HighlightSegment DS comprises a VideoSegmentLocator DS describing time information or a 
video itself of the highlight segment. 

4 
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19. (Canceled) 

20. (Currently Amended) The method of claim 18 wherein step (a) comprises 

the steps of: 

extracting features from the input original video and outputting the types of features 
and video time interval at which those features are detected; 

detecting key events included in the original video based on the types of features 
and video time interval at which those features are detected; and 

detecting episode by dividing the original video into story flow fease^on the basis of 
the detected event. 

21 .-22. (Canceled) 

23. (Previously Presented) The method of claim 18 wherein the step (d) 
comprises the step of extracting a representative sound from the video summary interval 
information. 

24. (Canceled) 

25. (Currently Amended) A system for generating video summary description 
data according to a video summary description scheme by inputting original video, comprising: 

video analyzing means for analyzing the original video and producing video 

analysis result; 

summary rule defining means for defining the summary rule for selecting the video 
summary interval; 

video summary interval selecting means for selecting the video interval capable of 
summarizing the video contents of the original video and outputting video summary interval 
information based on the video analysis result from the video analyzing means and the summary 
rule from the summary rule defining means; 

5 
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.representative frame extracting means for oirtputting a representative frame 



representing video summary interval based on the video summary interval information from the 
video summary interval selecting means; and 

video summary describing means for generating video summary description data 

with HierarchicalSummary DS by inputting the video summary interval information from the video 
summary interval selecting means and the representative frame information from the 
representative frame extracting means, 

wherein the HierarchicalSummary DS comprises a HighlightLevel DS that 
comprises at least one HighKgbtSegment DS, and the HighlightSegment DS describes information 
on segment ^formation corresponding to one of a plurality of video summary intervals, and the 
HighlightSegment DS comprises a VideoSegmentLocator DS describing time information or a 
video itself of the highlight segment and an ImageLocator DS describing a representative frame of 
the highlight segment the Hierarchirs.1 Summary DS providing direct access to content of the 
original video through the representative frame information . 

26. (Canceled) 



27. (Previously Presented) The system of claim 25 wherein said video 
analyzing means comprises: 

feature extracting means for extracting features from the original video and 
producing the types of features and video time interval at which those features are detected; 

event detecting means for detecting key events included in the original video by 
inputting the types of features and video time interval at which those features are detected; and 

episode detecting means for detecting episode by dividing the original video into 
story flow base on the basis of said detected event. 



28.-29. (Canceled) 



30. (Previously Presented) The system of claim 25, the system further 
comprises representative sound extracting means for extracting a representative sound by inrnitting 

6 
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the video summary interval information and providing the extracted representative sound to the 
video summary describing means. 

31.-32. (Canceled) 

33. (Previously Presented) The method of claim 18 wherein the 
HighlightSegment DS further comprises an ImageLocator DS describing a representative frame of 
the highlight segment 

34. (Previously Presented) The method of claim 18 wherein the 
ffighlightSegment DS further comprises SoundLocator DS describing a representative sound 
information of the highlight segment. 

35. (Previously Presented) The method of claim 18 wherein the 
HighlightSegment DS further comprises AudioSegmentLocator DS describing the audio segment 
information constituting an audio summary of the highlight segment. 

36. (Previously Presented) The method of claim 18 wherein the 
HierarcnicalSummary DS further includes SummaryThemeList DS enumerating the event or 
subject comprised in the summary and enabling user's to execute summarizing and browsing based 
on the event. 

37. (Previously Presented) The method of claim 36 wherein the 
SummaryThemeList DS includes arbitrary number of SummaryTheraes as elements, and the 
SummaryTheme includes an attribute of ID representing the corresponding event or subject. 

38. (Previously Presented) The method of claim 37 wherein the 
SummaryTheme further includes an attribute of parentID describing the ID of the event or subject 
of the upper level. 
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39. (Previously Presented) The method of 37 wherein the HighlightLevel DS 
includes an attribute of themelDs describing attribute of the ID, when the HighlightSegments or 
HighlightLevels which are constituting corresponding highlight level have common events or 
subjects, the ID of the common events or the subjects is described in the themelD. 

40. (Previously Presented) The method of claim 37 wherein the 
HighlightSegment DS includes an attribute of themelDs describing the event or subject of the 
highlight segment using the attribute of ID described in the SumraaryThemeList DS. 

41 _ (Previously Presented) The system of claim 25 wherein the 
HighlightSegment DS further comprises SoundLocator DS describing a representative sound 
information of the highlight segment. 

42. (Previously Presented) The system of claim 25 wherein the 
HighlightSegment DS farther comprises AudioSegmentLocator DS describing the audio segment 
information constituting an audio summary of the highlight segment 

43. (Previously Presented) The system of claim 25 wherein the 
HierarchicalSummary DS further includes SummaiyThemeList DS enumerating the event or 
subject comprised in the summary and enabling user's to execute summarizing and browsing based 
on the event. 

44. (Currently Amended) An apparatus for browsing video summary 
description data, wherein the video summary description data has a HierarchicalSummary 
Description Scheme (DS) for describing a video summar y from an original video , the | 
HierarchicalSummary DS includes: a HighlightLevel DS which comprises at least one 
HighlightSegment DS describing information on highlight segment corresponding one of video 
summary intervals, and a SummaryThemeList DS enumerating the event or subject comprised in 
the summary and enabling user's to execute summarizing and browsing based on the event, 
wherein the HighlightSegment DS includes a VideoSegmentLocator DS describing time 

8 
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information or video itself of the highlight segment, and an ImageLocator DS describing a 
representative frame of the highlight segment, wherein the browsing apparatus comprising: 

a video playing part for playing an original video or the video summary; 

an original video representative frame part for playing a representative frame of the 

original video; 

a first video summary representative frame part for playing a first summary level of 

video interval, 

a second video summary representative frame part for playing a second summary 
level of video interval, wherein the second summary level is summarized more finely than the first 
summary level; 

a level selecting part for selecting the first summary level or the second summary 
level thereby enabling the video playing part to play the selected summary level; and 

an event selecting part for enumerating the event or the subject provided in the 
Summary TbemeList DS for a user to browse desired even t: and 

a direct access part to provide direct access to the contents of the original video 
through the original video representative fra me part when plavinf? the first summary level of video 
interval o r the second summary level of video interval. 

45. (Previously Presented) The apparatus of claim 44 wherein the first video 
summary representative frame part plays the first summary level of sound information, and the 
second video summary representative frame part plays the first summary level of sound 
information. 

46, (Previously Presented) The apparatus of claim 45 wherein the 
HighlightSegment DS further comprises: 

a SoundLocator DS describing a representative sound information of the highlight 

segment; and 

an AudioSegmentLocator DS describing the audio segment information constituting 
an audio summary of the highlight segment. 

9 
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47, (Currently Amended) A method of browsing video summary description 
datacard a ccessing o ri ginal video , wherein the video summary description data having a 
HierarchicalSummary Description Scheme (DS) for describing a video summary, 

wherekHhe HierarchicalSummary DS coinprisc s -having a HighlightLevel DS which 
comprises at least one HighlightSegment DS describing information on highlight segment 
corresponding one of video summary intervals, and 

whorcin t he HighlightSegment DS compriscs - h aving a VideoSegmentLocator DS 
describing time information or video itself of the highlight segment, and an ImageLocator DS 
describing a representative frame of the highlight segment, 

wherein t he browsing method-eemprise s comprising : 

(a) playing a first summary level of video summary; and 

(b) playing a_video interval of theoriginal video corresponding to the 
representative frame when a desired scene is found through the video summary representative 
frame at the step fa) ; and 

£c) directly a ccessing the original video through the video summary 

representative frame when plavinp the first summary level of video summary or when playing the 
vi deo interva l of the original video corresponding to the representative frame , 

48. (Previously Presented) The method of claim 47, further comprising: 

(c) playing a second summary level of video summary when a desired scene is 
not found through the video summary representative frame at the step (a), wherein the second 
summary level is summarized more finely than the first summary level. 

49. (Previously Presented) The method of claim 47 wherein the 
HighlightSegment DS fiirther comprises a SoundLocator DS describing a representative sound 
information of the highlight segment, the step (b) comprising the step of recognizing the desired 
scene to be found at the step (a) through the video summary representative sound information. 

50. (Previously Presented) The method of claim 47 wherein the 
HierarchicalSummary DS further includes SummaryThemeList DS enumerating the event or 

10 
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subject comprised in the summary and enabling user's to execute summarizing and browsing based 
on the event. 

51. (Currently Amended) A Video Summary Description Scheme (DS) for 
describing a video summar y of an original video T comprising: 

at least one HighlightSegment DS describing information on ^highlight segment 
corresponding tp ac leagLone efWideo summar y int e rvals interval, wherein the HighlightSegment 
DS comprises a VideoSegmentLocator DS describing time information or video itself of the 
highlight segment and an ImageLocator DS describing a representative frame of the highlight 
segments the HighlightSegment DS providing direct access to the original video through the 
representative frame . 

52. (Previously Presented) The Video Summary DS of claim 51 wherein the 
HighlightSegment DS further comprises SoundLocator DS describing a representative sound 
information of the highlight segment. 

53. (Previously Presented) The Video Summary DS of claim 51 wherein the 
HighlightSegment DS further comprises AudioSegmentLocator DS describing the audio segment 
information constituting an audio summary of the highlight segment. 

54. (Currently Amended) A method of browsing video summary description 
data wherein of an original video^ the video summary description data having at least one 
HighlightSegment DS describing information on ^highlight segment corresponding to one of a 
plurality of video summary intervals, wtefeia-the HighlightSegment DS comprises i ncluding a 
VideoSegmentLocator DS describing time information or video itself of the highlight segment and 
an ImageLocator DS describing a representative frame of the highlight segment, 

whereia-the browsing method comprising: 

(a) playing a first summary level of the video summary; sad 



11 



PAGE 15/29 ' RCVD AT 8/412006 2:06:16 PM [Eastern Daylight Time] * SVR:USPTO€FXRF-6/31 ' DN1S:273S3D0 * CSID:206 682 6031 * DURATION (mm*ss):Q4-20 



08/04/2006 10:00 FAX 206 682 8031 SEED IP LAW GROUP PLLC lg]016 

Application No. 09/675,984,__,, ^ . 

Reply to Office Action dated January 3 0, 2006 W 

(b) playing a_video interval of the_original video corresponding to the representative 
frame when a desired scene is found through the video summary representative frame at the step 
fa) : and 

^ directly accessing the co ntents of the original video when plavin a the first summary 

level of the video summary or playing th e video interval of the original video . 

55. (Previously Presented) The method of claim 54 further comprising: 

(c) playing a second summary level of video summary when a desired scene is not 
found through the video summary representative frame at the step (a), wherein the second 
summary level is summarized more finely than the first summary level . 

56. (Previously Presented) The method of claim 54 wherein the 
HighlightSegment DS further comprises a SoundLocator DS describing a representative sound 
information of the highlight segment, the step (b) comprising the step of recognizing the desired 
scene to be found at the step (a) through the video summary representative sound information. 

57. (New) The method of claim 54, wherein directly accessing comprises 
directly accessing the contents of the original video through the representative frame. 
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